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1 Introduction 

From a physical point of view, spin glasses, as dilute magnetic alloys, are very 
interesting systems. They are characterized by such features as exhibiting 
a new magnetic phase, where magnetic moments are frozen into disordered 
equilibrium orientations, without any long-range order. See for example PP 
for general reviews, and also j2] for a very readable account about the physical 
properties of spin glasses. The experimental laboratory study of spin glasses 
is a very difficult subject, because of their peculiar properties. In partic- 
ular the existence of very slowly relaxing modes, with consequent memory 
effects, makes difficult to realize the very basic physical concept of a system 
at thermodynamical equilibrium, at a given temperature. 

From a theoretical point of view some models have been proposed, which 
try to capture the essential physical features of spin glasses, in the frame of 
very simple assumptions. 

The basic model has been proposed by Edwards and Anderson |3j many 
years ago. It is a simple extension of the well known nearest neighbour Ising 
model. On a large region A of the unit lattice in d dimensions, we associate 
an Ising spin (y{n) to each lattice site n, and then we introduce a lattice 
Hamiltonian 

Hf,{a, J) = -Y^ Jin, n')a{n)a{n'). (1) 

(n,n') 

Here, the sum runs over all couples of nearest neighbour sites in A, and J 
are quenched random couplings, assumed for simplicity to be independent 
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identically distributed random variables, with centered unit Gaussian distri- 
bution. The quenched character of the J means that they do not partecipate 
to thermodynamic equilibrium, but act as a kind of random external noise 
on the coupling of the a variables. In the expression of the Hamiltonian, we 
have indicated with a the set of all cr(n), and with J the set of all J{n,n'). 
The region A must be taken very large, by letting it invade all lattice in the 
limit. The physical motivation for this choice is that for real spin glasses the 
interaction between the spins dissolved in the matrix of the alloy oscillates 
in sign according to distance. This effect is taken into account in the model 
through the random character of the couplings between spins. 

Even though very drastic simplifications have been introduced in the for- 
mulation of this model, as compared to the extremely more complicated 
nature of physical spin glasses, nevertheless a rigorous study of all properties 
emerging from the static and dynamic behavior of a thermodynamic system 
of this kind is far from beeing complete. In particular, with reference to static 
equilibrium properties, it is not possible yet to reach a completely substanti- 
ated description of the phases emerging in the low temperature region. Even 
physical intuition gives completely different guesses for different people. 

In the same way as a mean field version can be associated to the ordinary 
Ising model, so it is possible for the disordered model described by ((H). Now 
we consider a number of sites i = 1,2, . . . , N, and let each spin a{i) at site 
i interact with all other spins, with the intervention of a quenched noise Jij. 
The precise form of the Hamiltonian will be given in the following. 

This is the mean field model for spin glasses, introduced by David Sher- 
rington and Scott Kirkpatrick more that thirty years ago jSj- It is a 
celebrated model. Hundreds and hundreds of articles have been devoted to 
its study during the years, appearing in the theoretical physics literature. 

The relevance of the model stems surely from the fact that it is intended 
to represent some important features of the physical spin glass systems, of 
great interest for their peculiar properties, at least at the level of the mean 
field approximation. 

But another important source of interest is connected with the fact that 
disordered systems, of the Sherrington-Kirkpatrick type, and their general- 
izations, seems to play a very important role for theoretical and practical 
assessments about hard optimization problems, as it is shown for example 
by Mark Mezard, Giorgio Parisi and Riccardo Zecchina in 6j. 

It is interesting to remark that the original paper was entitled "Solvable 
Model of a Spin-Glass" , while a previous draft, as told by David Sherrington, 
contained even the stronger denomination "Exactly Solvable". However, it 
turned out that the very natural solution devised by the authors is valid only 
at high temperatures, or for large external magnetic fields. While, at low 
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temperatures, the proposed solution exhibits a nonphysical drawback given 
by a negative entropy, as properly recognized by the authors in their very 
first paper. 

It took some years to find an acceptable solution. This was done by 
Giorgio Parisi in a series of papers, by marking a radical departure from 
the previous methods. In fact, a very deep method of "spontaneous replica 
symmetry breaking" was developed. As a consequence the physical content 
of the theory was encoded in a functional order parameter of new type, and 
a remarkable structure emerged for the pure states of the theory, a kind of 
hierarchical, ultrametric organization. These very interesting developments, 
due to Giorgio Parisi, and his coworkers, are explained in a brilliant way in 
the classical book 0. Part of this structure will be recalled in the following. 

It is important to remark that Parisi solution is presented in the form 
of an ingenious and clever Ansatz. Until few years ago it was not known 
whether this Ansatz would give the true solution for the model, in the so 
called thermodynamic limit, when the size of the system becomes infinite, or 
it would be only a very good approximation for the true solution. 

The general structures offered by the Parisi solution, and their possible 
generalizations for similar models, exhibit an extremely rich and interesting 
mathematical content. Very appropriately, Michel Talagrand has inserted a 
strongly suggestive sentence in the title to his recent book [8^ : "Spin glasses: 
a challenge for mathematicians" . 

As a matter of fact, how to face this challenge is a very difficult problem. 
Here we would like to recall the main features of a very powerful method, yet 
extremely simple in its very essence, based on a comparison and interpolation 
argument on sets of Gaussian random variables. 

The method found its first simple application in pi, where it was shown 
that the Sherrington-Kirkpatrick replica symmetric approximate solution was 
a rigourous lower bound for the quenched free energy of the system, uniformly 
in the size. Then, it was possible to reach a long waited result ^0]: the 
convergence of the free energy density in the thermodynamic limit, by an in- 
termediate step where the quenched free energy was shown to be subadditive 
in the size of the system. 

Moreover, still by interpolation on families of Gaussian random variables, 
the first mentioned result was extended to give a rigorous proof that the 
expression given by the Parisi Ansatz is also a lower bound for the quenched 
free energy of the system, uniformly in the size [TT]. The method gives 
not only the bound, but also the explicit form of the correction in a quite 
involved form. As a recent and very important result, along the task of facing 
the challenge, Michel Talagrand has been able to dominate these correction 
terms, showing that they vanish in the thermodynamic limit. This milestone 
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achievement was firstly announced in a short note containing only a 
synthetic sketch of the proof, and then presented with all details in a long 
paper to be published on Annals of Mathematics ^Hj • 

The interpolation method is also at the basis of the far reaching gener- 
alized variational principle proven by Michel Aizenman, Robert Sims and 
Shannon Starr in (14j . 

In our presentation, we will try to be as self-contained as possible. We will 
give all definitions, explain the basic structure of the interpolation method, 
and show how some of the results are obtained. We will concentrate mostly 
on questions connected with the free energy, its properties of subadditivity, 
the existence of the infinite volume limit, and the replica bounds. 

For the sake of comparison, and in order to provide a kind of warm up, we 
will recall also some features of the standard elementary mean field model of 
ferromagnetism, the so called Curie- Weiss model. We will concentrate also 
here on the free energy, and systematically exploit elementary comparison 
and interpolation arguments. This will show the strict analogy between the 
treatment of the ferromagnetic model and the developments in the mean field 
spin glass case. Basic roles will be played in the two cases, but with different 
expressions, by positivity and convexity properties. 

Then, we will consider the problem of connecting results for the mean 
field case to the short range case. An intermediate position is occupied by 
the so called diluted models. They can be studied through a generalization 
of the methods exploited in the mean field shown for example in J3] . 

The organization of the paper is as follows. In Section 2, we introduce the 
ferromagnetic model and discuss behavior and properties of the free energy 
in the thermodynamic limit, by emphasing, in this very elementary case, 
the comparison and interpolation methods that will be also exploited, in a 
different context, in the spin glass case. 

Section 3 is devoted to the basic features of the mean field spin glass 
models, by introducing all necessary definitions. 

In Section 4, we introduce, for generic Gaussian interactions, some im- 
portant formulae, concerning the derivation with respect to the strength of 
the interaction, and the Gaussian comparison and interpolation method. 

In next Section 5 we give simple applications to the mean field spin 
glass model, in particular to the existence of the infinite volume limit of the 
quenched free energy [lOj, and to the proof of general variational bounds, by 
following the useful strategy developed in [T3j. 

Section 6 will briefly recall the main features of the Parisi representation, 
and will state the main theorem concerning the free energy. 

In Section 7 we will make some mention about results for diluted models. 

Finally, in Section 8, we attack the problem of connecting the results for 
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the mean field case to the more reahstic short range models. 

Section 9 will be devoted to conclusions and outlook for future foreseen 
developments. 

Our treatment will be as simple as possible, by relying on the basic struc- 
tural properties, and by describing methods of presumably very long lasting 
power. The enphasis given to the mean field case reflects the status of re- 
search. May be that after some years from now this review would be written 
according to completely different patterns. 

2 A warm up. The mean field ferromagnetic 
model. Structure and results. 

The mean field ferromagnetic model is among the simplest models of statis- 
tical mechanics. However, it contains very interesting features, in particular 
a phase transition, characterized by spontaneous magnetization, at low tem- 
peratures. We refer to standard textbooks, for example for a full treat- 
ment, and a complete appreciation of the model in the frame of the theory of 
ferromagnetism. Here we consider firstly some properties of the free energy, 
easily obtained through comparison methods. 

The generic configuration of the mean field ferromagnetic model is defined 
through Ising spin variables CTj = ±1, attached to each site i = 1,2, . . . , N. 

The Hamiltonian of the model, in some external field of strength h, is 
given by the mean field expression 



Here, the first sum extends to all N{N — l)/2 site couples, and the second 
to all sites. 

For a given inverse temperature jS, let us now introduce the partition 
function Z^iP, h) and the free energy per site /Ar(/?, h), according to the well 
known definitions 






(3) 



(4) 



It is also convenient to define the average spin magnetization 




(5) 



5 



Then, it is immediately seen that the Hamiltonian in Q can be equiva- 
lently written as 

H^{a,h) = -^Nm^-hJ2^^, (6) 

i 

where an unessential constant term has been neglected. In fact we have 

where the sum over all couples has been equivalently written as one half the 
sum over all i,j with i ^ j, and the diagonal terms with i = j have been 
added and subtracted out. Notice that they give a constant because af = 1. 

Therefore, the partition function in Q can be equivalently substituted 
by the expression 

Z^{(3,h)= exp{^(3Nm')exp{(3hJ2(^^), (8) 

which will be our starting point. 

Our interest will be in the limTv^oo log Ziy{P, h). To this purpose, let 
us establish the important subadditivity property, holding for the splitting of 
the big N site system in two smaller Ni site and N2 site systems, respectively, 
with N = Ni + N2, 

log Z^{(3,h)< log ZN,{l3,h) + log ZN,{(3,h). (9) 

The proof is very simple. Let us denote, in the most natural way, by 
(Ti, . . . , the spin variables for the first subsystem, and by ctat^+i, . . . ,aN 
the N2 spin variables of the second subsystem. Introduce also the subsys- 
tem magnetizations mi and m2, by adapting the definition (0) to the smaller 
systems, in such a way that 

Nm = Nimi + A^2m2- (10) 

Therefore, we see that the large system magnetization m is the linear convex 
combination of the smaller system ones, according to the obvious 

m=— mi + —1712. (11) 

Since the mapping m —>■ is convex, we have also the general bound, 
holding for all values of the a variables 

< -^ml + -^ml (12) 
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Then, it is enough to substitute the inequahty in the definition (jHl) of Z^iP, h), 
and recognize that we achieve factorization with respect to the two subsys- 
tems, and therefore the inequahty < Zn-^Z^^. So we have estabhshed ©• 
From subadditivity, the existence of the hmit follows by a simple argument, 
as explained for example in In fact, we have 

lim A^-MogZjv(/9,/i) = inf A^-MogZjv(/?,/i). (13) 

Now we will calculate explicitely this limit, by introducing an order parameter 
M, a trial function, and an appropriate variational scheme. In order to 
get a lower bound, we start from the elementary inequality > 2mM — 
M^, holding for any value of m and M. By inserting the inequality in the 
definition (jH)) we arrive at a factorization of the sum over ex's. The sum 
can be explicitely calculated, and we arrive immediately to the lower bound, 
uniform in the size of the system, 

N-HogZN{(3,h) > log2 + log cosh /5(/i + M) - ^pM\ (14) 

holding for any value of the trial order parameter M. Clearly it is convenient 
to take the supremum over M. Then we establish the optimal uniform lower 
bound 

N-HogZN{P,h) > sup(log2 + logcosh/?(/i + M) - ^/?M2). (15) 
M 2 

It is simple to realize that the supremum coincides with the limit as 
— s> oo. To this purpose we follow the following simple procedure. Let 
us consider all possible values of the variable m. There are + 1 of them, 
corresponding to any number K of possible spin fiips, starting from a given 
a configuration, i^' = 0, 1, . . . , A^. Let us consider the trivial decomposition 
of the identity, holding for any m, 

1 = y^JmM, (16) 

M 

where M in the sum runs over the + 1 possible values of m, and 6 is 
Kroneker delta, beeing equal to 1 if M = A^, and zero otherwise. Let us now 
insert ()16p in the definition (jH)) of the partition function inside the sum over 
cr's, and invert the two sums. Because of the forcing m = M given by the 
6, we can write = 2mM — inside the sum. Then if we neglect the 6, 
by using the trivial S < 1, we have un upper bound, where the sum over cr's 
can be explicitily performed as before. Then it is enough to take the upper 
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bound with respect to M, and consider that there are N + 1 terms in the 
now trivial sum over M, in order to arrive at the upper bound 

N-^ log Zjv(/9, h) < sup(log 2 + log cosh (5{h + M)- ^pM^) + N-Hog{N+l). 
M 2 

(17) 

Therefore, by going to the limit as iV — oo, we can collect all our results 
in the form of the following theorem giving the full characterization of the 
thermodynamic limit of the free energy. 

Theorem 1. For the mean field ferromagnetic model we have 

lim iV-i log Zn{(3, h) = inf A^-i log Zn{P, h) (18) 

AT— ►oo N 

= sup(log2 + logcosh/3(/i + M) - ^/3M^). (19) 

M 2 

This ends our discussion about the free energy in the ferromagnetic model. 
Other properties of the model can be easily established. Introduce the 
Boltzmann-Gibbs state 

ujn{A) = Z],^ J2 Aexp(i/?iVm')exp(/5/i^aO, (20) 

where A is any function of cti ... cr at. 

The observable m{a) becomes self-averaging under cun, in the infinite 
volume limit, in the sense that 

lim (jJN((m - M((3, h)f) = 0. (21) 

This property of m is the deep reason for the success of the strategy exploited 
before for the convergence of the free energy. Easy consequences are the 
following. In the infinite volume limit, the Boltzmann-Gibbs state becomes 
a factor state 

lim un{(Ti . . . (7,) = M(/3, hf . (22) 

N—*oo 

A phase transition appears in the form of spontaneous magnetization. In 
fact, while for /i = and < 1 we have M(/?, h) = 0, on the other hand, for 
/3 > 1, we have the discontinuity 

lim M(/?, /i) = - lim_ M(/?, h) = M{(3) > 0. (23) 

Fluctuations can also be easily controlled. In fact, one proves that the 
rescaled random variable ^/N{m — M{P, h)) tends in distribution, under ujn, 
to a centered Gaussian with variance given by the suscettibility 

x(/3..).^M(ftft).^^L^^. (24) 



Notice that the variance becomes infinite only at the critical point h = 0, 
P = 1, where M = 0. 

Now we are ready to attack the much more difficult spin glass model. 
But it will be surprising to see that, by following a simple extension of the 
methods here described, we will arrive to similar results. 

3 The basic definitions for the mean field spin 
glass model 

As in the ferromagnetic case, the generic configuration of the mean field spin 
glass model is defined through Ising spin variables CTj = ±1, attached to each 
site i = l,2,...,N. 

But now there is an external quenched disorder given by the A^(A^ — l)/2 
independent and identical distributed random variables Jij, defined for each 
couple of sites. For the sake of simplicity, we assume each Jij to be a centered 
unit Gaussian with averages E{Jij) = 0, E{Jfj) = 1. By quenched disorder 
we mean that the J have a kind of stochastic external influence on the system, 
without partecipating to the thermal equilibrium. 

Now the Hamiltonian of the model, in some external field of strength h, 
is given by the mean field expression 

H^ia, h, J) = — ^ ^ JijCTiCj - /i ^ cTi. (25) 

Here, the first sum extends to all site couples, an the second to all sites. 
Notice the \/N, necessary to ensure a good thermodynamic behavior to the 
free energy. 

For a given inverse temperature (3, let us now introduce the disorder 
dependent partition function Zn{P, h, J) and the quenched average of the 
free energy per site fN^P, h), according to the definitions 

ZN{P,h,J)= J2 ^M-PHMia,h,J)), (26) 

(Tl...(Tjv 

-PfNiP, h) = N-'E log Z^iP, h, J). (27) 

Notice that in ()27j) the average E with respect to the external noise is made 
after the log is taken. This procedure is called quenched averaging. It 
represents the physical idea that the external noise does not partecipate to 
the thermal equilibrium. Only the ex's are thermalized. 

For the sake of simplicity, it is also convenient to write the partition 
function in the following equivalent form. First of all let us introduce a family 
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of centered Gaussian random variables /C(o"), indexed by the configurations 
cr, and characterized by the covariances 

E{IC{a)IC{a')) = q\a,a'), (28) 

where q{a, a') are the overlaps between two generic configurations, defined 

by 

qia,a')=N-'J2a,ai (29) 

i 

with the obvious bounds —1 < q{a, a') < 1, and the normalization g(o", a) = 
1. Then, starting from the definition (j2Hl), it is immediately seen that the par- 
tition function in (j26|l can be also written, by neglecting unessential constant 
terms, in the form 

ZM{(3,h,J)= J2 exp(/5y^/C(a))exp(/3/i5^a,), (30) 
which will be the starting point of our treatment. 



4 Basic formulae of derivation and interpola- 
tion 

We work in the following general setting. Let Ui be a family of centered 
Gaussian random variables, i = 1,. . . ,K, with covariance matrix given by 
E{UiUj) = Sij. We treat the index i now as configuration space for some 
statistical mechanics system, with partition function Z and quenched free 
energy given by 

E\ogJ2wiexp{ViUi) = E\ogZ, (31) 

i 

where Wi > are generic weigths, and t is a parameter ruling the strength 
of the interaction. 

It would be hard to underestimate the relevance of the following derivation 
formula 

-^E log Wj exp{y/tUi) = 

i 

^E{Z^^ ^ Wi exp{ViUi)Sii 

i 

-\e{Z-^ w,w, expiViU,) exp{ViU,)Sij). (32) 

i j 
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The proof is straigthforward. Firstly we perform directly the t derivative. 
Then, we notice that the random variables appear in expressions of the form 
E{UiF), were F are functions of the t/'s. These can be easily handled through 
the following integration by parts formula for generic Gaussian random vari- 
ables, strongly reminiscent of the Wick theorem in quantum field theory, 

E{U,F)=Y,S.,E{^F). (33) 

Therefore, we see that always two derivatives are involved. The two terms 
in ()32|) come from the action of the Uj derivatives, the first acting on the 
Boltzmann factor, and giving rise to a Kronecker 6ij, the second acting on 
Z~^, and giving rise to the minus sign and the duplication of variables. 

The derivation formula can be expressed in a more compact form by 
introducing replicas and suitable averages. In fact, let us introduce the state 
00 acting on functions F of i as follows 

cu{Fii)) = Z-'J2^i^MVtUi)F{i), (34) 

i 

together with the associated product state Q acting on replicated configura- 
tion spaces ii, 12, ... , ig. By performing also a global E average, finally we 
define the averages 

{F)t = EniF), (35) 

where the subscript is introduced in order to recall the t dependence of these 
averages. 

Then, the equation ()32|) can be written in a more compact form 

^E\og^Wiexp{ViU.i) = ^{Si,i,) - ^{Si.i^). (36) 

i 

Our basic comparison argument will be based on the following very simple 
theorem. 

Theorem 2. Let Ui and Ui, for i = 1, . . . , K , be independent families of cen- 
tered Gaussian random variables, whose covariances satisfy the inequalities 
for generic configurations 

E{U,U,) = Si, > E{U,Uj) ^ Sij, (37) 

and the equalities along the diagonal 

EiUiUi) = Su = E{U,U,) = S^i, (38) 
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then for the quenched averages we have the inequality in the opposite sense 

ElogJ2^^^MU^) < E\0gJ2^i^MU^), (39) 
i i 

where the Wi > are the same in the two expressions. 

Considerations of this kind are present in the mathematical hterature of 
some years ago. Two typical references are jlH] and [THj . 

The proof is extremely simple and amounts to a straigthforward calcula- 
tion. In fact, let us consider the interpolating expression 

Elog^w,exp(Vt[/i + VT^Ui), (40) 

i 

where < t < 1. Clearly the two expressions under comparison correspond 
to the values t = and t = 1 respectively. By taking the derivative with 
respect to t, with the help of the previous derivation formula, we arrive to 
the evaluation of the t derivative in the form 

log Wi exp{ViUi + Vl - tUi) = 

i 

-E(Z"^ ^ Wi exp{VtUi) (Sii - Sii) 

i 

-\e{Z~^ J2 Y1 ^MViU,) exp{VtU,){Si, - Sij). (41) 

From the conditions assumed for the covariances, we immediately see that 
the interpolating function is nonincreasing in t, and the theorem follows. 

The derivation formula and the comparison Theorem are not restricted to 
the Gaussian case. Generalizations in many directions are possible. For the 
diluted spin glass models and optimization problems we refer for example to 
PU] , and to [T3], and references quoted there. 

5 The thermodynamic limit and the varia- 
tional bounds 

We give here some striking applications of the basic comparison Theorem. 
In 1^ we have given a very simple proof of a long waited result, about the 
convergence of the free energy per site in the thermodynamic limit. Let us 
show the argument. Let us consider a system of size and two smaller 
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systems of sizes Ni and N2 respectively, with N = Ni + N2, as before in the 
ferromagnetic case. Let us now compare 

ElogZN{f3,h,J)=E\og exp{f3^)C{a))exp{f3hJ2a,), (42) 

ai...a]\[ i 



with 



Elog exp(/3y^/C«(a«))exp(/3y^/C(^)(a(^)))exp(/3/^5^a. 



cri...crjv 



= E log Zj^^ {(3,h,J) + E log Zn, {13, h, J) , (43) 

where a^^^ are the (cij, 2 = 1,..., Ni), and cr*^^^ are the (cij, i = Ni + 1, . . . , A^). 
Covariances for K,^^^ and K.^'^^ are expressed as in (j2Hl), but now the overlaps 
are substituted with the partial overlaps of the first and second block, qi and 
q2 respectively. It is very simple to apply the comparison theorem. All one 
has to do is to observe that the obvious 

Nq = Niqi + A^aga, (44) 

analogous to (fTUj) . imphes, as in (fT^. 

, A^i , A^2 9 
<}' < -J^i + -^4- (45) 

Therefore, the comparison gives the superaddivity property, to be compared 
with Q, 

E log Zn{(3, h,J)>E log Zn, (/?, h,J) + E log Z^, (P, h, J) . (46) 
From the superaddivity property the existence of the limit follows in the form 
lim N-^E\ogZN{P,h,J) = supN-^E\ogZN{P,h,J), (47) 

to be compared with (|T!?jl . 

The second application is in the form of the Aizenman-Sims-Starr gen- 
eralized variational principle. Here, we will need to introduce some auxil- 
iary system. The denumerable configuration space is given by the values 
of a = 1,2, . . .. We introduce also weights Wa > for the a system, and 
suitably defined overlaps between two generic configurations p{a,a'), with 
p{a, a) = 1. 

A family of centered Gaussian random variables }C{a), now indexed by 
the configurations a, will be defined by the covariances 

E{IC{a)IC{a')) =p\a,a'). (48) 
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We will need also a family of centered Gaussian random variables rjiia), 
indexed by the sites i of our original system and the configurations a of the 
auxiliary system, so that 

E{r)i{a)r)i,{a')) = 6u'p{a,a'). (49) 

Both the probability measure Wa, and the overlaps p{a, a') could depend 
on some additional external quenched noise, that does not appear explicitely 
in our notation. 

In the following, we will denote by E averages with respect to all random 
variables involved. 

In order to start the comparison argument, we will consider firstly the 
case where the two a and a systems are not coupled, so to appear factorized 
in the form 

= E log Zjv(/3, h,J) + E log exp(/?y^;C(a)). (50) 

a 

In the second case the /C fields are suppressed and the coupling between 
the two systems will be taken in a very simple form, by allowing the t] field 
to act as an external field on the a system. In this way the cr's appear as 
factorized, and the sums can be explicitely performed. The chosen form for 
the second term in the comparison is 

^^og Y X]^«exp(/3^?7i(a)ai)exp(/3/i^crj) 

(71... (Tat Ot i i 

= Nlog2 + ElogJ2wa{ciC2...CN), (51) 

a 

where we have defined 

cosh P{h + rji{a)), (52) 

as arising from the sums over cr's. 

Now we apply the comparison Theorem. In the first case, the covariances 
involve the sums of squares of overlaps 

^{q\a,a')+p\a,a')). (53) 
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In the second case, a very simple calculation shows that the covariances 
involve the overlap products 



q{a,a')p{a,a'f). (54) 

Therefore, the comparison is very easy and, by collecting all expressions, we 
end up with the useful estimate, as in ^1], holding for any auxiliary system 
as defined before, 

N-^E\ogZN{(3,h,J) < (55) 
log2 + A^~^(Elog^w„(ciC2 . . .Cat) - E\og^Waexp{pJ y/C(a))). 



6 The Parisi representation for the free en- 
ergy 

We refer to the original paper and to the extensive review given in 
for the general motivations, and the derivation of the broken replica Ansatz, 
in the frame of the ingenious replica trick. Here we limit ourselves to a 
synthetic description of its general structure, independently from the replica 
trick 

First of all, let us introduce the convex space X of the functional order 
parameters x, as nondecreasing functions of the auxiliary variable q, both x 
and q taking values on the interval [0, 1], i.e. 

X3x: [0,1] 3 q^x{q)e [0,1]- (56) 

Notice that we call x the function, and x{q) its values. We introduce a metric 
on X through the L^([0, 1], dq) norm, where dq is the Lebesgue measure. 

For our purposes, we will consider the case of piecewise constant func- 
tional order parameters, characterized by an integer K, and two sequences 
qo, qi, qx , rui, 1712, ... , of numbers satisfying 

= qo < qi < . . . < qx-i < Q'a' = 1, < mi < m2 < . . . < mx < 1, (57) 

such that 

x{q) = nil for = qo < q < qi, x{q) = m2 for qi < q < q2, 

x{q) = niK for qx-i <q<qK- (58) 

In the following, we will find convenient to define also mo = 0, and m^+i = 1- 
The replica symmetric case of Sherrington and Kirkpatrick corresponds to 

K = 2, qi = q, mi = 0, m2 = 1. (59) 
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Let us now introduce the function /, with values f{q, y; x, (3), of the vari- 
ables g e [0,1], y E R, depending also on the functional order parameter x, 
and on the inverse temperature f3, defined as the solution of the nonlinear 
antiparabolic equation 

idj)iq,y) + l{d'j)iq,y) + y) = 0, (60) 

with final condition 

fil,y) = \ogcoshi/3y). (61) 

Here, we have stressed only the dependence of / on g and y. 

It is very simple to integrate Eq. (jUnj) when x is piecewise constant. In 
fact, consider x{q) = rria, for qa-i < q < qa, firstly with rria > 0. Then, it is 
immediately seen that the correct solution of Eq. (jHn|) in this interval, with 
the right final boundary condition at g = g^, is given by 

IXq, y) = — log / exp{maf{qa, y + Zy/qa - g)) dn{z), (62) 
rria J 

where dfi{z) is the centered unit Gaussian measure on the real line. On the 
other hand, if rria = 0, then ()6()|1 loses the nonlinear part and the solution is 
given by 

f{Q,y) = J f{Qa,y + zy/%^)dfx{z), (63) 

which can be seen also as deriving from (jU^ in the limit rria ~^ 0. Starting 
from the last interval K, and using (jU^ iteratively on each interval, we easily 
get the solution of (p]j) . (jHH), in the case of piecewise order parameter x, as 
in ()58|1 . through a chain of interconnected Gaussian integrations. 

Now we introduce the following important definitions. The trial auxiliary 
function, associated to a given mean field spin glass system, as described in 
Section 3, depending on the functional order parameter x, is defined as 

log 2 + f{0,h-x,(3)-^j^q x{q) dq. (64) 

Notice that in this expression the function / appears evaluated at g = 0, 
and y = h, where h is the value of the external magnetic field. This trial 
expression shoul be considered as the analog of that appearing in (|THl for 
the ferromagnetic case. 

The Parisi spontaneously broken replica symmetry expression for the free 
energy is given by the definition 

-/5/p(/3,/i) = inf(log2 + /(0,/i;a;,/3)-^ / qx{q)dq), (65) 



16 



where the infimum is taken with respect to all functional order parameters 
X. Notice that the infimum appears here, as compared to the supremum in 
the ferromagnetic case. 

In [TT], by exploiting a kind of generalized comparison argument, in- 
volving a suitably defined interpolation function, we have established the 
following important result. 

Theorem 3. For all values of the inverse temperature (3, and the external 
magnetic field h, and for any functional order parameter x, the following 
hound holds 



N-^E\og Zn{(3, h, J) < log 2 + /(O, h-x,f3)-^ j^q 



x{q) dq, 



uniformly in N . Consequently, we have also 

N-'Elog Zn{(3, h, J) < inf (log 2 + /(O, h; x,(5)-^ f q x{q) dq), 
uniformly in N . 

However, this result can be understood also in the frame of the general- 
ized variational principle established by Aizenman-Sims-Starr and described 
before. 

In fact, one can easily show that there exist an a systems such that 

N~^Elog'^WaCiC2 ...cn = /(O, h;x,P), (66) 



N-'E\ogY,w^exp{f3^ICia)) ^(^j\x{q) dq. 



(67) 



uniformly in N. This result stems from previous work of Derrida, Ruelle, 
Neveu, Bolthausen, Sznitman, Aizenman, Contucci, Talagrand, Bovier, and 
others, and in a sense is implicit in the treatment given in [Zj. It can be 
reached in a very simple way. Let us sketch the argument. 

First of all, let us consider the Poisson point process yi > y2 > ■ ■ ■, 
uniquely characterized by the following conditions. For any interval A, in- 
troduce the occupation numbers N{A), defined by 

N{A) = J2x{yaeA), (68) 

a 

where x() = if random variable ya belongs to the interval A, and 
x{) = 0, otherwise. We assume that N{A) and N{B) are independent if the 
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intervals A and B are disjoint, and moreover that for each A, the random 
variable N[A) has a Poisson distribution with parameter 

= [ exp(-y) dy, (69) 

J a 

if A is the interval (a, 6), i.e. 

P(Ar(A) = A;) = exp(-;u(A))/i(A)VA;!. (70) 

We will exploit —i/a as energy levels for a statistical mechanics systems with 
configurations indexed by a. For a parameter < m < 1, playing the role of 
inverse temperature, we can introduce the partition function 

v = J2^M-)- (71) 

a 

For m in the given interval it turns out that f is a very well defined random 
variable, with the sum over a extending to infinity. In fact, there is a strong 
inbuilt smooth cutoff in the very definition of the stochastic energy levels. 

From the general properties of Poisson point processes it is very well 
known that the following basic invariance property holds. Introduce a ran- 
dom variable b, independent of y, subject to the condition E{expb) = 1, 
and let ba be independent copies. Then, the randomly biased point process 
y'a = Ua + a = 1, 2, . . . is equivalent to the original one in distribution. 
An immediate consequence is the following. Let / be a random variable, in- 
dependent of such that E{exp f) < oo, and let /„ be independent copies. 
Then the two random variables 

5^exp(^)exp(/„), (72) 

a 

J2^M-)E{exp{mf))^ (73) 

777- 

a 

have the same distribution. In particular they can be freely substituted under 
averages. 

The auxiliary system which gives rise to the Parisi representation accord- 
ing to (jnni) (inZ|), for a plecewlse constant order parameter, is expressed in the 
following way. Now a will be a multi- index a = {ai, 02, ... , ax), where each 
aa runs on 1,2,3, . . .. Define the Poisson point process ya^, then, indepen- 
dently, for each value of ai processes yaia2y and so on up to yaia2...aK- Notice 
that in the cascade of independent processes yai,yaia2y ■ ■ • 1/0102. ..a^) the last 
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index refers to the numbering of the various points of the process, while the 
first indexes denotes independent copies labelled by the corresponding a's. 
The weights Wa have to be chosen according to the definition 

Wa = exp exp . . . exp . (74) 

mi 1712 ™K 

The cavity fields t] and /C have the following expression in terms of indepen- 
dent unit Gaussian random variables 4^, 4^^^, . . . , "^"i' '^aia2' • • • ' '^aiaa-.c^K' 



^(") = V ^1 ~ ^oJ'a, + V ^2 - lfJ'a^a2 + ■ ■ ■ + \/ 1k ' -l^'a^a^.-.a^ ■ (76) 

It is immediate to verify that E{rii[a)rii/{a') is zero if z 7^ i', while 

E{r]i{a)r]i{a')) = if ai 7^ a[, 

= qi if ai = a[, 02 7^ «2, 

= q2 if «! = a[, a2 = a2, ^ ctg, 



1 if «! = a[, a2 = a'2, . . . , aK = cn'j^- (77) 



Similarly, we have 



E(/C(a)/C(a')) = Oifai^a'i, 

= ql if ai = a[, 0^2 7^ 0:2, 

= 52 if '^1 = '^2 = «25 '^3 7^ '^35 

= 1 if ai = a']^, 0^2 = 0^2, • • • , = OLj^. (78) 

This ends the definition of the a system, associated to a given piecewise 
constant order parameter. 

Now, it is simple to verify that (jUBj) (jU7j) hold. Let us consider for ex- 
ample (jnni). With the a system chosen as before, the repeated application 
of the stochastic equivalence of (f?^ and (fTHj) will give rise to a sequence of 
interchained Gaussian integrations exactly equivalent to those arising from 
the expression for /, as solution of the equation (jHUjl . For (f7H|l . there are 
equivalent considerations. 

Therefore we see that the estimate in Theorem El is also a consequence of 
the generalized variational principle. 

Up to this point we have seen how to obtain upper bounds. The problem 
arises whether, as in the ferromagnetic case, we can also get lower bounds. 
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so to shrink the thermodynamic hmit to the value given by the inf^. in The- 
orem 01 After a short announcement in Michel Talagrand wrote an 
extended paper ^Hj, to appear on Annals of Mathematics, where the com- 
plete proof of the control of the lower bound is firmly established. We refer 
to the original paper for the complete details of this remarkable achievement. 
About the methods, here we only recall that in .llj we have given also the 
corrections to the bounds appearing in Theorem albeit in a quite compli- 
cated form. Talagrand has been able to establish that these corrections do 
in fact vanish in the thermodynamic limit. 

In conclusion, we can establish the following extension of Theorem ^ to 
spin glasses. 

Theorem 4. For the mean field spin glass model we have 



7 Diluted models 

Diluted models, in a sense, play a role intermediate between the mean field 
case and the short range case. In fact, while in the mean field model each site 
is interacting with all other sites, on the other hand, in the diluted model, 
each site is interacting with only a fixed number of other sites. However, 
while for the short range models there is a definition of distance among sites, 
relevant for the interaction, no such definition appears in the diluted models, 
where all sites are in any case equivalent. From this point of view, the 
diluted models are structurally similar to the mean field models, and most 
of the techniques and results explained before can be extended to them. 

Let us define a typical diluted model. The quenched noise is described 
as follows. Let be a Poisson random variable with parameter aN, where 
N is the number of sites, and a is a parameter entering the theory, to- 
gether with the temperature. We consider also a sequence of independent 
centered random variables Ji, J2, ■ ■ ., and a sequence of discrete independent 
random variables ii, ji,i2, j2, ■ ■ uniformly distributed over the set of sites 
1, 2, . . . , A^. Then we assume as Hamiltonian 



lim N-^ E log ZN{P,h, J) 



sup N-^ E log ZN{P,h, J) 



(79) 




N 

/•I 




K 





k=0 
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Only the variables a partecipate to thermodynamic equilibrium. All noise 
coming from K, Jk,ik, jk is considered quenched, and it is not explicitely 
indicated in our notation for H. 

The role played by Gaussian integration by parts in the Sherrington- 
Kirckpatrick model, here is assumed by the following elementary derivation 
formula, holding for Poisson distributions. 



Then, all machinery of interpolation can be easily extended to the diluted 
models, as firstly recognized by Franz and Leone in pUj . 

In this way, the superaddivity property, the thermodynamic limit, and 
the generalized variational principle can be easily established. We refer to 
PU] , and |T3], for a complete treatment. 

There is an important open problem here. While in the fully connected 
case the Poisson probability cascades provide the rigth auxiliary a systems 
to be exploited in the variational principle, on the other hand in the diluted 
case more complicated probability cascades have been proposed, as shown for 
example in [20], and in [221 • other hand, in the very interesting 

proposal has been made that also in the case of diluted models the Poisson 
probability cascades play a very important role. Of course here the way 
how the auxiliary system interact with the original system is different, and 
involves a multi-overlap structure as explained in [13] • In this way a kind 
of very deep universality is emerging. Poisson probability cascades are a 
kind of universal class of auxiliary systems. The different models require 
different cavity fields ruling the interaction between the original system and 
the auxiliary system. But further work will be necessary in order to clarify 
this very important issue. For results about diluted models in the high 
temperature region, we refer to 

8 The short range model and its connections 
with the mean field version 

The investigation of the connections between the short range version of the 
model and its mean field version are at the beginning. Here we limit ourselves 
to a synthetic description of what should be done, and to a short presentation 
of the results obtained so far. 

First of all, according to the conventional wisdom, the mean field version 
should be a kind of limit of the short range model on a lattice in dimension d, 



dt 



P{K = k,taN) 




aN{P{K = k-l, taN) - P{K = k, taN)). (82) 
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when d ^ oo, with a proper rescahng of the strength of the Hamihonian, of 
the form d~2. Results of this kind are very well known in the ferromagnetic 
case, but the present technology of interpolation does not seem sufficient to 
assure a proof in the spin glass case. So this very basic result is still missing. 
In analogy with the ferromagnetic case, it would be necessary to arrive at 
the notion of a critical dimension, beyond which the features of the mean 
field case still hold, for example in the expression of the critical exponents 
and in the ultrametric hierarchical structure of the pure phases, or at least 
for the overlap distributions. For physical dimensions less than the critical 
one, then the short range model would need corrections with respect to its 
mean field version. Therefore, this is a completely open problem. 

Moreover, always according to the conventional wisdom, the mean field 
version should be a kind of limit of the short range models, in finite fixed 
dimensions, as the range of the interaction goes to infinity, with proper rescal- 
ing. Important work of Franz and Toninelli shows that this is effectively the 
case, if a properly defined Kac limit is performed. Here, interpolation meth- 
ods are effective, and we refer to [211, E^l ^oi full details. 

Due to the lack of efficient analytical methods, it is clear that numerical 
simulations play a very important role in the study of the physical properties 
emerging from short range spin glass models. In particular, we refer to j2ZI 
and [2F , for a detailed account about the evidence, coming from theoretical 
considerations and extensive computer simulations, that some of the more 
relevant features of the spontaneous replica breaking scheme of the mean 
field are also present in short range models in three dimensions. Different 
views are expressed for example in [SH], where it is argued that the phase 
space structure of short range spin glass models is much simpler than that 
foreseen by the Parisi spontaneous replica symmetry mechanism. 

Such very different views, both apparently strongly supported by rea- 
sonable theoretical considerations and powerful numerical simulations, are a 
natural consequences of the extraordinary difficulty of the problem. 

It is clear that extensive additional work will be necessary before the 
clarification of the physical features exhibited by the realistic short range 
spin glass models. 

9 Conclusion and outlook for future develop- 
ments 

As we have seen, in these last few years there has been an impressive progress 
in the understanding of the mathematical structure of spin glass models. 
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mainly due to the systematic exploration of comparison and interpolation 
methods. However many important problems are still open. The most im- 
portant one is to establish rigorously the full hierarchical ultrametric or- 
ganization of the overlap distributions, as appears in Parisi theory, and to 
fully understand the decomposition in pure states of the glassy phase, at low 
temperatures. 

Moreover, is would be important to extend these methods to other impor- 
tant disordered models as for example neural networks. Here the difficulty 

is that the positivity arguments, so essential in comparison methods, do not 
seem to emerge naturally inside the structure of the theory. 

Finally, the problem of connecting properties of the short range model, 
with those arising in the mean field case, is still almost completely open. 
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